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METHOD AND APPARATUS FOR COMPUTER ASSISTANCE 
WITH INTRAMEDULLARY NAIL PROCEDURE 

TECHNICAL FIELD OF THE INVENTION 

The present invention relates generally to computer-assisted surgery systems and 

surgical navigation systems. 

BACKGROUND OF THE INVENTION 

Image-based surgical navigation systems display the positions of surgical tools with 
respect to preoperative (prior to surgery) or intraoperative (during surgery) image data sets. 
Two and three dimensional image data sets are used, as weU as time-variant images data (i.e. 
multiple data sets taken at different times). Types of data sets that are primarily used include 
two-dimensional fluoroscopic images and three-dimensional data sets include magnetic 
resonance imaging (MRI) scans, computer tomography (CT) scans, positron emission 
tomography (PET) scans, and angiographic data. Intraoperative images are typically 
fluoroscopic, as a C-arm fluoroscope is relatively easily positioned with respect to patients 
and does not require that a patient be moved. Other types of imaging modalities require 
extensive patient movement and thus are typically used only for preoperative and post- 
operative imaging. 

The most popular navigation systems make use of a tracking or localizing system to 
track tools, instruments and patients during surgery. These systems locate in predefined 
coordinate space specially recognizable markers that are attached or affixed to, or possibly 
inherently a part of, an object such as an instrument or a patient. Markers can take several 
forms, including those that can be located using optical (or visual), electromagnetic, radio or 
acoustic methods. Furthermore, at least in the case of optical or visual systems, location of 
an object's position may be based on intrinsic features or landmarks that, in effect, function 
as recognizable markers. Markers will have a known, geometrical arrangement with respect 
to, typically, an end point and/or axis of the instrument. Thus, objects can be recognized at 
least in part from the geometry of the markers (assuming that the geometry is unique), and 
the orientation of the axis and location of endpoint within a frame of reference deduced from 
the positions of the markers. 
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Present-day tracking systems are typically optical, functioning primarily in the 
infrared range. They usually include a stationary stereo camera pair that is focused around 
the area of interest and sensitive to infrared radiation. Markers emit infrared radiation, either 
actively or passively. An example of an active marker is light-emitting diodes (LEDs). An 
example of a passive marker is a reflective marker, such as ball-shaped marker with a surface 
that reflects incident infrared radiation. Passive systems require a an infrared radiation source 
to illuminate the area of focus. A magnetic system may have a stationary field generator that 
emits a magnetic field that is sensed by small coils integrated into the tracked tools. 

Most CAS systems are capable of continuously tracking, in effect, the position of 
tools (sometimes also called instruments). With knowledge of the position of the relationship 
between the tool and the patient and the patient and image data sets, a system is able to 
continually superimpose a representation of the tool on the image in the same relationship to 
the anatomy in the image as the relationship of the actual tool to the patient's anatomy. To 
obtain these relationships, the coordinate system of the image data set must be registered to 
the relevant anatomy of the actual patient portions of the of the patient's anatomy in the 
coordinate system of the tracking system. There are several known registration methods. 

In CAS systems that are capable of using two-dimensional image data sets, multiple 
images are usually taken from different angles and registered to each other so that a 
representation of the tool or other object (which can be real or virtual) can be, in effect, 
projected into each image. As the position of the object changes in three dimensional space, 
its projection into each image is simultaneously updated. In order to register two or more 
two-dimensional data images together, the images are acquired with what is called a 
registration phantom in the field of view of the image device. In the case of a two 
dimensional fluoroscopic images, the phantom is a radio-translucent body holding radio- 
opaque fiducials having a known geometric relationship. Knowing the actual position of the 
fiducials in three dimensional space when each of the images are taken permits determination 
of a relationship between the position of the fiducials and their respective shadows in each of 
the images. This relationship can then be used to create a transform for mapping between 
points in three-dimensional space and each of the images. By knowing the positions of the 
fiducials with respect to the tracking system's frame of reference, the relative positions of 
tracked tools with respect to the patient's anatomy can be accurately indicated in each of the 
images, presuming the patient does not move after the image is acquired, or that the relevant 
are portions of the patient's anatomy is are tracked. A more detailed explanation of 
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registration of fluoroscopic images and coordination of representations of objects inpatient 
space superimposed in the images is found in United States Patent 6,198,794 of Peshkin, et 
al., entitled "Apparatus and method for planning a stereotactic surgical procedure using 
coordinated fluoroscopy". 



ST TMMAR Y OF THE INVENTION 

The invention is generally directed to improved computer-implemented methods and 
apparatus for further reducing the invasiveness of surgical procedures, eliminating or 
reducing the need for external fixtures in certain surgical procedures, and/or improving the 
precision and/or consistency of surgical procedures. The invention finds particular advantage 
in orthopedic procedures involving implantation of devices, though it may also be used in 
connection with other types of surgical procedures. 

For example, a surgeon encounters or has to overcome several problems during 
insertion of an intramedullary nail ("JM nail"), an elongated rod-shaped prosthetic device, 
into the canal of a fractured femur. These problems include matching the leg length of the 
injured leg with the well leg of the patient, improper rotation of the injured leg, and 
unpredictable flexing of the distal end of the nail. To reduce the incidence of malrotation of 
the leg, fluoroscopic images are taken frequently during the procedure, thus exposing the 
patient and operating room personnel to radiation. Furthermore, implantation of the IM nail 
using traditional methods requires use of an extra pin for determining the version of the leg 
for proper alignment of the rod, as well as use of a special, radio-translucent drill so that 
fluoroscopic images can be captured during insertion of screws into the distal end of the 
femur to secure the distal end of the nail. 

To address one or more of these problems, various aspects of a specially- 
programmed, computer-assisted surgery system are used to reduce the number of 
fluoroscopic images required to be taken, especially during the course of the procedure, 
elhninate the need for a Steinman pin, and assist the surgeon in properly aligning and 
securing the nail during insertion. A preferred embodiment of such an application for 
programming a computer-assisted surgery system is described below. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, the objects and 
advantages thereof reference is now made to the following descriptions taken in connection 
with the accompanying drawings in which: 

FIG. 1 is a block diagram of an exemplary computer-assisted surgery system; 

FIG. 2 is a simple diagram of a patient having a fractured femur and prepared for 
surgery; 

FIG. 3 is a flow chart of basic steps of an application program for assisting with or 
guiding the planning and execution of a surgical procedure and navigation during the 
procedure; 

FIG. 4 is a flow chart of basic set-up steps for an application for assisting with 
planning o£ and navigation during, an intramedullary nail procedure; 

FIG. 5 is a flow chart of basic steps of a reference determination portion of the 
planning phase of the application of FIG. 4; 

FIGS. 6 A is a more detailed flow chart of basic steps of reference dimensions and a 
nail determination portion of a phase of the application of FIG. 4; 

FIGS. 6B is a more detailed flow chart of planning injured leg for determination of 
fracture site, length and anteversion for the application of FIG. 4; 

FIG. 7 is a detailed flow chart of a navigation/execution phase of the application of 
FIG. 4; and 

FIGS. 8-27 are representative screens of graphical user interface pages displayed by 
the computer-assisted surgery system of FIG. 1 during use of the application of FIG. 4. 

DETAILED DESCRIPTION OF THE DRAWINGS 

In the following description, like numbers refer to like elements. References to 
"surgeon" include any user of a computer-assisted surgical system, a surgeon being typically 
a primary user. 

FIG. 1 is a block diagram of an exemplary computer-assisted surgery (CAS) system 
10. Computer-assisted surgery system (CAS) 10 comprises a display device 12, an input 
device 14, and a processor-based system 16, for example, a computer. Display device 12 may 
be any display device now known or later developed for displaying two-dimensional and/or 
three-dimensional diagnostic images, for example, a monitor, a touch screen, a wearable 
display, a projection display, a head-mounted display, stereoscopic views, a holographic 
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display, a display device capable of displaying image(s) projected from an image projecting 
device, for example, a projector, and/or the like. Input device 14 may be any input device 
now known or later developed, for example, a keyboard, a mouse, a trackball, a trackable 
probe and/or the like. The processor-based system is preferably programmable and includes 
one or more processors 16a, working memory 16b for temporary program and data storage 
that will be used primarily by the processor, and storage for programs and data, preferably 
persistent, such as a disk drive. Removable media storage device 18 can also be used to store 
programs and/or transfer to or from the transfer programs. 

Tracking system 22 continuously determines, or tracks, the position of one or more 
trackable markers disposed on, incorporated into, or inherently a part of surgical tools or 
instruments 20 with respect to a three-dimensional coordinate frame of reference. With 
information from the tracking system on the location of the trackable markers, CAS system 
10 is programmed to be able to determine the three-dimensional coordinates of an endpoint or 
tip of a tool and, optionally, its primary axis using predefined or known (e.g. from 
calibration) geometrical relationships between trackable markers on the tool and the end point 
and/or axis of the tool. A patient, or portions of the patient's anatomy, can also be tracked by 
attachment of arrays of trackable markers. 

The CAS system can be used for both planning surgical procedures (including 
planning during surgery) and for navigation. It is therefore preferably programmed with 
software for providing basic image-guided surgery functions, including those necessary 
determining the position of the tip and axis of instruments and for registering a patient and 
preoperative and/or intraoperative diagnostic image data sets to the coordinate system of the 
tracking system. The programmed instructions for these functions are indicated as core CAS 
utilities 24. These capabilities allow the relationship of a tracked instrument to a patient to be 
displayed and constantly updated in real time by the CAS system overlaying a representation 
of the tracked instrument on one or more graphical images of the patient's internal anatomy 
on display device 12. The graphical images are constructed from one or more stored image 
data sets 26 acquired from diagnostic imaging device 28. Imaging device may be a 
fluoroscope, such as a C-arm fluoroscope, capable of being positioned around a patient lying 
on an operating table. It may also be a MR, CT or other type of imaging device in the room or 
permanently located elsewhere. Where more than one image is shown, as when multiple 
fluoroscopic images are simultaneously displayed of display device 12, the representation of 
the tracked instrument or tool is coordinated between the different images. However, CAS 
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system can be used in some procedures without the diagnostic image data sets, with only the 
patient being registered. Thus, the CAS system need not support the use of diagnostic images 
in some applications - i.e. an imageless application. 

Furthermore, as disclosed herein, the CAS system may be used to run application- 
5 specific programs 30 that are directed to assisting a surgeon with planning and/or navigation 
during specific types of procedures. For example, the application programs may display 
predefined pages or images corresponding to specific steps or stages of a surgical procedure. 
At a particular stage or part of a program, a surgeon may be automatically prompted to 
perform certain tasks or to define or enter specific data that will permit, for example, the 
10 program to determine and display appropriate placement and alignment of instrumentation or 
implants or provide feedback to the surgeon. Other pages may be set up to display diagnostic 
images for navigation and to provide certain data that is calculated by the system for 
feedback to the surgeon. Instead of or in addition to using visual means, the CAS system 
could also communicate information in ways, including using audibly (e.g. using voice 
15 synthesis) and tactilely, such as by using a haptic interface of device. For example, in 
addition to indicating visually a trajectory for a drill or saw on the screen, a CAS system may 
feedback to a surgeon information whether he is nearing some object or is on course with a 
audible sound or by application of a force or other tactile sensation to the surgeon's hand. 

To further reduce the burden on the surgeon, the program may automatically detect 
the stage of the procedure by recognizing/identifying the instrument picked up by a surgeon 
and move immediately to the part of the program in which that tool is used. Application data 
32 - data generated or used by the application — may also be stored processor-based system. 

Various types of user input methods can be used to improve ease of use of the CAS 
system during surgery. One example is the use of speech recognition to permit a doctor to 
speak a command. Another example is the use of a tracked object to sense a gesture by a 
surgeon, which is interpreted as an input to the CAS system. The meaning of the gesture 
could further depend on the state of the CAS system or the current step in an application 
process executing on the CAS system. Again, as an example, a gesture may instruct the CAS 
system to capture the current position of the object One way of detecting a gesture is to 
occlude temporarily one or more of the trackable markers on the tracked object (e.g. a probe) 
for a period of time, causing loss of the CAS system's ability to track the object. A 
temporary visual occlusion of a certain length (or within a certain range of time), coupled 
with the tracked object being in the same position before the occlusion and after the 
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occlusion, would be interpreted as an input gesture. A visual or audible indicator that a 
gesture has been recognized could be used to provide feedback to the surgeon. 

Yet another example of such an input method is the use of tracking system 22 in 
combination with one or more trackable data input devices 34. Defined with respect to the 
5 trackable input device 34 are one or more defined input areas, which can be two-dimensional 
or three-dimensional. These defined input areas are visually indicated on the trackable input 
device so that a surgeon can see them. For example, the input areas may be visually defined 
on an object by representations of buttons, numbers, letters, words, slides and/or other 
conventional input devices. The geometric relationship between each defined input area and 

10 the trackable input device is known and stored in processor-based system 16. Thus, the 
processor can determine when another trackable object touches or is in close proximity a 
defined input area and recognize it as an indication of a user input to the processor-based 
systems. For example, when a tip of a tracked pointer is brought into close proximity to one 
of the defined input areas, the processor-based system will recognize the tool near the defined 

15 input area and treat it as a user input associated with that defined input area. Preferably, 
representations on the trackable user input correspond with user input selections (e.g. buttons) 
on a graphical user interface on display device 12. The trackable input device may be formed 
on the surface of any type of trackable device, including devices used for other purposes. In a 
preferred embodiment, representations of user input functions for graphical user interface are 

20 visually defined on a rear, flat surface of a base of a tool calibrator. 

Processor-based system 16 is, in one example, a programmable computer that is 
programmed to execute only when single-use or multiple-use software is loaded from, for 
example, removable media. The software would include, for example the application 
program 30 for use with a specific type of procedure. Media storing the application program 

25 can be sold bundled with disposable instruments specifically intended for the procedure. The 
application program would be loaded into the processor-based system and stored there for use 
during one (or a defined number) of procedures before being disabled. Thus, the application 
program need not be distributed with the CAS system. Furthermore, application programs can 
be designed to work with specific tools and implants and distributed with those tools and 

30 implants. Preferably, also, the most current core CAS utilities may also be stored with the 
application program. If the core CAS utilities on the processor-based system are outdated, 
they can be replaced with the most current utilities. 
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FIG. 2 is intended to be a representative patient with a representative fractured femur. 
The representative patient 200, represented by a head 202, torso 204, arm 206, leg 208 and 
knee 210. Indicated by dashed lines in the upper leg, above the knee, is a femur 212 that is 
fractured and separated into two pieces, which will be referred to as the proximal fragment 
214 and distal fragment 216 to correspond with the proximal end 218 and distal end 220 of 
the femur. A trackable marker array 212, which can be tracked by the CAS system 10 (FIG. 
1), is attached to, respectively, the proximal piece 214 and distal piece 216 of the femur so 
that the relative position of the two pieces can be tracked during implantation of an IM nail 
into the femur. 

Referring now to FIG. 3, the CAS system assists a surgeon in performing an IM nail 
implantation by executing a process 300 that has three basic phases: set-up phase 302, 
planning phase 304 and navigation phase 306. The set-up phase involves the surgeon 
specifying to the process which type of IM nail to be used which leg is to be operated on, 
type of fracture, instruments and/or tools to be tracked during the procedure, and model 
fluoroscope to be used, which leg is to be operated on, type of fracture, instruments, and/or 
tools during the process and certain other options such as deteimining to image and plan 
using the uninjured leg. The set-up phase allows for skipping certain steps during the 
navigation or execution stage so that it flows more efficiently to the surgeon's preferences or 
needs. The planning phase involves using fluoroscopic images to gather reference 
information on leg version (rotation angle) and length from the surgeon and to select nail 
dimensions, and placement and length of screws used to secure the nail. The navigation or 
execution stage tracks the surgeon's instruments and trackable markers implanted in or 
attached to the patient's femur and provides alignment information and feedback on version 
and length. 

Process 300, or parts thereof, preferably display a series of pages corresponding to 
stages or sub-procedures, each page being set up to display directions and information 
(including images) relevant to the stage of the procedure. However, as previously mentioned, 
the CAS system may in addition to the pages or in place of the pages, communicate some or 
all of this information by other means, including audible and haptic means. Although the 
process may constrain what a surgeon does in terms of the ordering of certain steps, the 
process preferably follows the surgeon, rather than requiring the surgeon to follow the 
process. This is particularly useful during the planning and navigation or execution phases of 
the process, where the surgeon may need to go back and change a plan or repeat steps. Thus, 



WO 2004/069040 



9 



PCT/US2004/003068 



in the following explanation of process 300, some steps may be performed out of sequence or 
repeated The surgeon may indicate to the process the stage he or she is in or wants to go to. 
This may be done through user input or by the process automatically recognizing when the 
surgeon has either finished a stage or is preparing to go to another stage (not necessarily the 
5 next stage) by, for example, the surgeon picking up an instrument used in a particular stage 
and showing it to the cameras of the tracking system. Details of the process 300 will be 
described with reference to representative examples of screens from such pages, shown in 
FIGS. 8-27. These screens contemplate use of IM nails for a specific vendor. However, the 
process and concepts embodied or represented by the pages are not limited to any specific 

10 vendor, and aspects thereof may be employed in connection with surgical planning and 
guidance systems for similar types of implants. 

Referring to FIG. 4 and FIGS 8-13, step 402 asks the surgeon to identify or select 
which of a plurality of IM nail types or families will be used. This information is used for 
representing the IM nail on images taken of the patient's leg and providing feedback to title 

15 surgeon on the position of the nail during the nail insertion. If the process is set up for only 
one type of nail, this step may be skipped. FIG. 8 is a screen of a representative example of 
such a page, in this case showing four families of IM nails from a particular vendor. At steps 
404, 406, and 408, the process requests the surgeon to specify which leg is injured, what type 
of fluoroscope will be used, and whether the uninjured leg of the patient will be used in 

20 planning. FIG. 9 is an example of a graphical interface displaying the options for selection by 
the surgeon. Although the use a fluoroscopic images has certain advantages, other types of 
images can be used in place of, or in addition to, the fluoroscopic images, including without 
limitation preoperative three-dimensional data sets such as CT and MRI scans. 

At step 410 the surgeon is asked to specify application-specific tools that he will use 

25 during the procedure that can be or will be tracked. Surgeons may prefer to use different 
tools for a given step, and this step permits the surgeon to select the tool of choice so that the 
CAS system can properly track it. The application may display a different page at a given 
step, or display pages in a different order, based on selection of the tool. Furthermore, a 
surgeon may, for example, elect not to use a tool during a given step, or not have it tracked. 

30 The process will adjust as necessary to accommodate the preferences to avoid forcing a 
surgeon to find ways to bypass steps or alter presentation of the pages. The CAS system is 
typically programmed or set up to operate with a probe and other basic tools that a surgeon 
may use. 
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Preferably, the surgeon is given a list of the tool or tools that the application can track, 
from which he may select. FIG. 10 shows an example of a page that displays the tools that the 
application is capable of or set up to track for the basic steps of the surgical procedure. The 
display permits the surgeon to visually select the tool (or not to have a tool) and verify the 
selection. The tool listing in the illustrated example is also grouped by basic stages of the 
process. In the example, options are given for the tool that will be used for defining an entry 
point in the femur prior to insertion of the nail, the tool used for nail insertion, the instrument 
used for drilling holes to insert screws for locking the distal end of the nail, and other tools 
that the surgeon may want to use. Thus, in the example, if no tool is selected for specifying 
the entry point, the program will not expect to receive an indication for the entry point and 
will not attempt to display the selected point on a diagnostic image. If, for example, a 
surgeon selects a power drill instead of a hand drill for distal locking, the CAS system will 
automatically assume that it is tracking a power drill during the distal locking step. 

At step 412, the CAS system calibrates the selected fluoroscope using known 
methods. The interface for this step is illustrated in FIG. 11. 

Steps 414, 416, 418 and 420 direct the acquisition of certain fluoroscopic images 
during the procedure, followed by registration of those images using known methods. If the 
surgeon specified that the well leg would be used for reference, images of the well leg are 
acquired in addition to images of the injured leg. Exemplary screen shots of the pages 
corresponding to the acquisition and registration of the well leg and injured leg are shown in 
FIGS. 12 and 13, respectively. What images are needed or desirable are listed and identified 
with respect to the list when they are acquired. In the illustrated examples, the required or 
desirable images are listed with reference to target areas 1202 defined on diagrams 1204 of a 
femur. The diagrams show a femur from an anterior/posterior and from a medial/lateral 
view. It is preferred to acquire an anterior/posterior (A/P) and a medial/lateral (M/L) image of 
each of the proximal and distal ends of the femur, fluoroscopic image pair is around the 
midshaft of the femur. Area 1202 may consist of two fracture sites, depending upon the set- 
up phase. This allows for handling a compound fracture and allows the surgeon to image the 
proximal and distal fractures in separate shots. Each A/P and M/L fluoroscopic image pair is 
preferably shown in two, side-by-side windows on the display. During image acquisition, 
window 1206 displays a current image from the fluoroscope. Once a surgeon is satisfied with 
an image, it is saved or stored by the CAS system upon appropriate input from the surgeon 
and is moved to adjacent window 1208 for registration. 
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Referring now to FIG. 5, if a well leg is imaged, the planning stage starts with a 
process 500. With the images of the well leg, certain reference information, namely a 
reference length and version, are determined at step 502, based on information indicated on 
the images by the surgeon. Assuming that the injured and well legs are anatomically similar, 

5 the well leg may also be used to at least initially determine appropriate nail length and 
diameter at step 504. Using the well leg to determine this information may be desirable in the 
event it is difficult to determine this information from the injured leg. As indicated by step 
506, screw length placement and length may also be determined. 

FIGS. 6A and 6B illustrate in the planning stage in greater detail. Steps 602 to 608 

10 involve determination of a reference length and version of the leg or femur. During these 
steps the surgeon is prompted to indicate in the acquired images of the well leg certain 
anatomical landmarks, preferably the center of the femoral head, the axis of the femoral neck 
and shaft, an axis that extends transverse to the condyles at the posterior-most points of the 
condyles (the trans-epicondylar axis). However, other recognizable landmarks could be used 

1 5 for calculating a reference length and/ or version. 

At steps 601 and 602 the surgeon is prompted to indicate, and the process receives, an 
estimated nail diameter on isthmus of uninjured leg and the center of the femoral head and 
the axis of its neck with reference to displayed A/P and M/L images of the proximal end of 
the femur. As illustrated in representative page or interface of FIG. 14, a "bull's-eye" marker 

20 1402 is superimposed on A/P image 1404 and M/L image 1406 for assisting the surgeon in 
identifying the center of the generally spherical femoral head in both images. This bull's-eye 
marker is a two-dimensional projection of a series of nested, virtual spheres in the three 
dimensional space of the patient. As the surgeon moves the marker with respect to one image, 
its position is automatically updated with respect to the second image. The surgeon is, in 

25 effect, moving the virtual spheres. From the center point of the bull's-eye marker to a second 
end point extends another marker in the form of line 1408. It represents a virtual guide wire 
in the Ihree-dimensional space of the patient. The surgeon moves this virtual guide wire so 
that it extends along the axis of the femoral neck. Once the surgeon indicates that markers 
are in the correct position, the process moves automatically to step 604. 

30 At step 604, the process displays A/P and lateral images of the distal end of the femur. 

The surgeon indicates on the images a marker for services as a reference point for 
determining a reference length for the femur. The program stores this information. At step 
606, the reference length is calculated using the references marked on the proximal end of the 
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femur and the reference marked on the distal end of the femur. The program also prompts, 
using, for example, directions displayed on the displayed page, and receives from the surgeon 
at step 406 the position and orientation for the trans-epicondylar axis of the femur. FIG. 15 is 
an example of a screen used in these steps. The acquired A/P and lateral images, 1502 and 
1504, respectively, of the distal end of the well femur are displayed, along with a reference 
line 1506. The surgeon manipulates the position and orientation of the reference line in A/P 
image 1502 so that it is aligned with the trans-epicondylar axis. In the lateral view the 
surgeon manipulates the reference line 1506 so that it is positioned on the posterior most 
points of the condyles. Using the definition of the femoral neck axis received at step 604 and 
the definition of the trans-epicondylar axis received at step 406, a reference version is 
calculated at step 608. The trans-epicondylar axis also serves as a reference point for 
calculating a reference length. In order to have meaningful version and reference 
information, true A/P and lateral views of the distal end of the femur should be acquired, or 
they should be least taken at the substantially same angles as the A/P and lateral images of 
the distal end of the injured femur. The reference length and version are stored and displayed 
in area 1508 of the screen. As an alternative to using a reference line, the version may be 
calculated using a true lateral image of the distal end and placing a reference point on the 
knee center in both the A/P and lateral images. 

Steps 608, 610, 611, 612, 614 and 616 assist the surgeon with selecting a nail of 
appropriate length and screw dimensions using the well leg. At step 608, the surgeon 
indicates, with respect to A/P and MZL images of the distal and proximal ends of the femur, 
end points for the nail. The process automatically determines the distance between the end 
points and then it selects and displays on the images a representation of the closest standard 
length nail. As indicated by steps 610 and 611, screw placement and dimensions for the 
proximal end of the nail and the placement of the nail end are indicated with respect to the 
uninjured leg. A representation of the closest standard nail to the indications is then displayed 
at step 612. The surgeon is then permitted to change, shift, rotate and move the representation 
in order to check its fit. If the fit is not correct, the surgeon can change the end points and/or 
select a different nail, as indicated by steps 614 and 616. FIG. 16 is a representative screen 
from an example of a user interface page displayed on the CAS system implementing these 
steps. The page includes the stored A/P image 1602 and M/L image 1604 of the proximal 
end of the well-leg femur. Superimposed on this image is a marker, in the form of a cross- 
hair graphic 1606, for marking the estimated proximal end of the nail that will be implanted 
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in the other (injured) leg. A representation 1608 of the proximal end of the nail is also 
preferably superimposed on the two images, along with representations 1610 of screws that 
will be inserted through the proximal end of the femur and nail once the nail is fully inserted. 
The surgeon is permitted to change, shift, rotate and move the representation of the screws in 
5 order to check its fit. The page includes inputs for changing the position of the cross-hairs 
and representations. FIG. 17 is a representative screen of a page for the surgeon to mark an 
estimated location for the tip of the nail. The page includes the stored A/P image 1602 and 
M/L image 1606 of the distal end of the well- leg femur. It prompts the surgeon to move a 
marker, namely, the cross-hairs graphic 1706, to the estimated tip of the nail. The program 
10 then provides an estimated nail length and displays the two closest standard lengths for the 
type of nail being used on line 1710. The surgeon selects the desired length and the program 
moves the nail representation to the correct length for the surgeon to confirm that selected 
length. 

Referring now to FIG. 6B, the diameter of the nail is estimated using at step 618, the 

15 midshaft (isthmus) of the well or injured leg. FIG. 18 assumes that well-leg images were 
acquired at the midshaft of that leg's femur. The diameter of the canal of the femur, through 
which the nail will be inserted, is its narrowest at the isthmus. The page instructs the surgeon 
to place a reference marker 1806 along the canal of the femur and then select the best 
matching diameter from a list. As different nail diameters are selected, the width of the 

20 reference marker, which is a projection of a virtual, cylindrical object (corresponding 
generally to a diameter of a nail) in the three-dimensional patient space into the two- 
dimensional fluoroscopic images, changes. Once the surgeon decides on a diameter, it is 
stored and the process moves to injured leg planning. 

At step 620, the surgeon is prompted to mark in the images showing the edge of the 

25 fracture at the canal of the femur. A representative screen of the page displayed for this step 
is shown in FIG. 19. The stored A/P image 1902 and the stored lateral M/L image 1904 of 
the midshaft of the injured femur is displayed, and cross-hairs marker 1906 is also displayed 
and can be moved by the surgeon to mark the edge of the fracture. A representation 1908 of 
the nail is also superimposed for the surgeon to check and, if necessary, change the estimated 

30 nail diameter that will fit through the canal at the point of fracture. 

Injured-leg planning continues at steps 622 at the proximal end of the injured femur 
by the surgeon marking in the images the center of the femoral head and the axis of the 
femoral neck substantially in the same manner as discussed in connection with step 602. This 
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information will be used to calculate reference length and version for the injured leg. FIG. 20 
is a representative screen of the page displayed for this step. Its display includes the stored 
A/P and M/L images of the proximal end of the femur in windows 2002 and 2004. Like 
other pages, it includes written instructions prompting the surgeon to mark certain landmarks, 
5 namely, the femoral head and neck using a bull's eye marker 2006 and 2008, just as in FIG. 
14. 

In a manner similar to step 606, the same landmarks used in marking the distal end of 
the well femur in step 606 are marked at step 624 by the surgeon and stored for use in 
calculating reference length and version for comparison to the well leg. A representative 

10 screen of a display page for this step is shown in FIG. 21. It includes the stored A/P and M/L 
images 2102 and 2104 for the distal end of the injured leg. It also includes an A/P shot of the 
distal end of the well femur 21 06 for reference to ensure proper marking of the landmarks on 
the images 2102 and 2104. The reference line is shown on image 2106 in the position marked 
by the surgeon at step 606. As with step 606, trans-epicondylar axis is marked on the images 

1 5 with reference line 2 1 08 and stored. 

Once the reference points are marked, the process proceeds to steps 628 and 630, 
where the surgeon indicates to the process the entry point for the nail and desired position of 
the nail head and the screws that lock the nail head. As show in FIG. 22, a representative 
screen of an example of a page for receiving this information from the surgeon, the stored 

20 A/P and M/L images 2202 and 2204 of the distal end of the injured femur are displayed and 
overlaid with a representation 2206 of the previously selected nail and the locking screws 
2208. The nail head 2210, which defines the entry point for the nail into the femur, is also 
indicated. The surgeon shifts and rotates the representation of the nail so that it fits properly 
in the canal and the locking screws extend up the neck of the femur shown in the images. The 

25 representations of the screws axe fixed to the representation of the nail, and rotate and shift 
with it. When the surgeon is satisfied with the placement of the nail and locking screws, this 
information is stored. 

As a final step before execution, tools previously selected for use in the procedure are 
calibrated if they are not already calibrated at step 632. A representative screen of an 
30 exemplary page that may be displayed at this step is shown in FIG. 23. A list 2302 of 
selected tools is displayed. A surgeon selects each tool on the list for calibration. When the 
tool comes into the field view of the tracking system of the CAS system, the tool is 
recognized and instructions for calibration are displayed. Dining this step, the tip and, 
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optionally, axis of each tool is calculated with respect to a known point on a calibration 
fixture according to known methods. The calibration information is stored by the CAS system 
so that the relationship between the displayed representation of the tool and the diagnostic 
images is the same as the relationship between the actual tool and the patient. 
5 Referring now to FIG. 7, steps 702, 704, 706 and 708 involve guiding the surgeon to 

the correct entry point for inserting the nail. Referring now also to FIG. 24, the previously 
acquired and stored A/P and M/L images 2402 and 2404 are displayed. The entry point is 
also marked with markers 2406. Although not explicitly shown in the figures, the point of 
the tool selected/or use in forming the entry, in this case an awl, is continuously tracked by 

10 the CAS system and a representation of the position of the tip of the tool displayed on the 
images. The CAS system is continuous tracking relative changes in positions of the two 
fragments using trackable marker array 224 (see FIG. 2) attached to each fragment. The 
arrays are attached prior to registration of the images with the patient so that registration is 
not lost due to movement of either femoral fragment. With each leg fragment being tracked 

15 to maintain registration, the CAS system will compensate for movement of the fragments 
when displaying the position of tracked tools on the diagnostic images on the CAS system's 
display. In area or window 2414 of the display, illustrations of the objects being tracked are 
displayed, in this example, and awl and a trackable marker array. These illustrations also 
provide an indication to the surgeon if the tool or the marker array are out of the field of view 

20 of the camera by displaying, in the illustrated embodiment, a red outline on respective images 
in area 2414. This function is also present in subsequent tracking steps. 

In window or area 2407 the relative positions and orientations of the proximal and 
femoral fragments of the fractured femur are indicated by representations 2410 and 2408. 
This window is preferably displayed during steps 708 and 714. Displayed in area 2412 is 

25 reference length and version information that is continuously calculated based on the relative 
positions of the fragments. This tracking is possible due to the known relationship between 
trackable marker array and the reference landmarks specified on the fragment. At the time 
when the landmarks on each fragment were specified, the positions of the trackable markers 
were also stored, thereby permitting the relative relationship to be determined. Using the 

30 relative relationship between each trackable marker 224 and the landmarks on the fragment to 
which it is attached, the referenced lengths and version are calculated based on the relative 
positions of the two trackable markers. 
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Referring now to FIGS 7 and FIG. 25, after the surgeon forms the entry for the nail, 
he will "ream" the canal of the femur to prepare it for introduction of the nail. Although not 
tracked in the illustrated embodiment, the instrument used for reaming could be tracked to 
and its position could also be displayed on the images to ensure that it successfully bridges 
5 the fracture and enters the canal of the other fragment Since the reaming device must be 
flexible and is located inside the femur, optical tracking cannot be used. Magnetic tracking, 
though less precise, could be employed. Once the canal is prepared, the surgeon will employ 
a tool for inserting the nail, referred to as a nail inserter. The inserter is tracked by the CAS 
system. Bringing the nail inserter into view of the tracking system signals the application 
0 process to move to the next step, namely, to step 710. The geometric relationship between the 
tool and the nail is known from the calibration step performed earlier. Therefore, by tracking 
the tool inserter, which remains outside the patient, the position of the nail is known. 

In FIG. 25, the stored A/P and M/L images of the proximal end of the femur are 
displayed. Also displayed on images using representation 2506 is the current position of the 
5 nail and the screws as the nail is being inserted and rotated. The nail insertion tool is tracked. 
The position of the nail and screws is determined from the position of the nail insertion tool 
and the geometric relationship between the nail insertion tool and nail. As in FIG. 24, 
window 2407 displays the representations of the two fragments 2408 and 2410, of the femur 
in the relative positions and calculated reference lengths and versions 2412. The surgeon will 
use the nail and screw representations to ensure that the screws are correctly aligned with the 
femoral neck. The representations of the locking screws can be used as guides for drilling and 
inserting the screws. 

Once the surgeon inserts the nail and the proximal locking screws, the distal end 
locking screws must be inserted. The nail guide does not typically incorporate an external 
guide due at least in part to a possibility of the nail bending during insertion. In order to 
locate screw openings in the nail and determine trajectory of the screws, another set of lateral 
and A/P and M/L images of the distal end of the femur is required. Therefore, at step 712, the 
surgeon is prompted to acquire the additional images. FIG. 26 is an example of a page for 
guiding the surgeon in capturing the images. The current image for the fluoroscope is shown 
in window 2602. If the image is acceptable, it is stored and shown in window 2604. The 
shots or images to be acquired are, in this example, graphically illustrated in area 2606. 

The second set of stored A/P and M/L images of the distal end of the femur should 
clearly show the screw holes in the distal end of the nail. In order to clearly see the holes, the 
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lateral image needs to be a true lateral image relative to the nail. When a surgeon brings the 
instrument previously specified as being used for distal screw insertion into the area of focus 
of the tracking system, the CAS system preferably automatically displays a screen or page 
similar to the one of FIG. 27 and performs steps 714 and 716. The page of FIG. 27 includes 
the stored A/P image 2702 and lateral image 2704 of the distal end of the nail. To guide a 
surgeon in inserting the locking screw, a representation 2706 of the instrument being used for 
the insertion is superimposed on the images. A representation 2708 of the locking screw on 
the end of the instrument is also superimposed. 

At the conclusion of the procedure, the surgeon is prompted to specify whether to 
archive data generated by the procedure for later reference. The CAS system archives the 
data as directed, such as to a disk drive or removable media. This step is not illustrated. 

If desired, the different steps discussed herein may be performed in any order and/or 
concurrently with each other. Furthermore, if desired, one or more of the above described 
steps may be optional or may be combined without departing from the scope of the present 
invention. 

Embodiments of the present invention may be implemented in software, hardware, 
application logic or a combination of software, hardware and application logic. The software, 
application logic and/or hardware may reside on processor-based system 16 or on a 
removable storage medium. If desired, part of the software, application logic and/or 
hardware may reside on processor-based system 16 and part of the software, application logic 
and/or hardware may reside on the removable storage medium. 
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What is claimed is: 

1 . Apparatus for assisting with surgical procedure, comprising: 
a localizer; 

a computer in communication with the localizer, the computer storing and executing 
instructions for displaying a plurality of screens, a first one of the plurality of screens 
corresponding to a planning step for a procedure for inserting an intramedullary nail and a 
second one of the plurality of screens corresponding to a navigation step of the procedure, the 
.first one of the plurality of screens assisting with selection of the nail based on a patients 
anatomy and the second one of the plurality of screens indicating the position of the nail as it 
is being inserted into the patient's femur. 
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(57) Abstract: A specially-programmed, computer-assisted surgery system (10) is used to reduce the number of fluoroscopic images 
required to be taken during the course of a intramedullary nail procedure (300), eliminates the need for a Steinman pin, and assists 
the surgeon in properly aligning and securing the nail during insertion. 
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